Spectral and Dynamical Properties in Classes of Sparse Networks with 

Mesoscopic Inhomogeneities 
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We study structure, eigenvalue spectra and random walk dynamics in a wide class of networks 
with subgraphs (modules) at mesoscopic scale. The networks are grown within the model with three 
parameters controlling the number of modules, their internal structure as scale-free and correlated 
subgraphs, and the topology of connecting network. Within the exhaustive spectral analysis for both 
the adjacency matrix and the normalized Laplacian matrix we identify the spectral properties which 
characterize the mesoscopic structure of sparse cyclic graphs and trees. The minimally connected 
nodes, clustering, and the average connectivity affect the central part of the spectrum. The number 
of distinct modules leads to an extra peak at the lower part of the Laplacian spectrum in cyclic 
graphs. Such a peak does not occur in the case of topologically distinct tree-subgraphs connected 
on a tree. Whereas the associated eigenvectors remain localized on the subgraphs both in trees and 
cyclic graphs. We also find a characteristic pattern of periodic localization along the chains on the 
tree for the eigenvector components associated with the largest eigenvalue = 2 of the Laplacian. 
Further differences between the cyclic modular graphs and trees are found by the statistics of random 
walks return times and hitting patterns at nodes on these graphs. The distribution of first return 
times averaged over all nodes exhibits a stretched exponential tail with the exponent cr « 1/3 for 
trees and cr ~ 2/3 for cyclic graphs, which is independent on their mesoscopic and global structure. 

PACS numbers: 89.75.Hc, 05.40.Fb, 02.70.-c 



I. INTRODUCTION 

Complex dynamical systems and network mesoscopic 
structure. In recent years a lot of attention has been de- 
voted to the problem of representing the complex dynam- 
ical systems by networks and investigating their struc- 
tural and dynamical properties [ij. These networks of- 
ten exhibit inhomogeneity at all scales, from the local 
level (individual nodes), to mesoscopic (groups of nodes) 
and global network level. The mesoscopic inhomogene- 
ity of networks may be defined as topologically distinct 
groupings of nodes in a range from few nodes to large 
modules, communities, or different interconnected sub- 
networks. These subgraphs play an important role in the 
network's complexity along the line from the local inter- 
actions to emergent global behavior, both in the structure 
and the function of networks 0,0. Hence, the charac- 
teristic subgraphs can be defined not only topologically 
but also dynamically, and different subgraphs appear to 
characterize different functional networks. In particu- 
lar, communities are often studied in social networks 
topological modules [3] and characteristic dynamical mo- 
tifs [5j are found in genetic interactions and communi- 
cation networks, whereas paths and trees appear as rel- 
evant subgraphs in the networks representing biochemi- 
cal metabolic processes and neural networks jGj] . Chains, 
representing a special type of motifs, have been observed 
in networks of words in books and the power grid net- 
works, 7]. In these examples the mesoscopic topology 
is related to dynamics of the whole network. On the 
other side, we have multi-networks consisting of a few 



interconnected networks in which the internal structure 
and possibly also dynamics might be different [8]. Then 
the interaction between such diverse networks leads to 
emergent global behavior, as for instance in the networks 
representing interacting eco-systems Q. 

Understanding the mesoscopic structure of networks 
in both topological and dynamical sense is, therefore, 
of paramount importance in the quantitative study of 
complex dynamical systems. Recently much attention 
was devoted to network's topolo gica l modularity, such as 
community structure [isj . where a 

wide range of methods are designed to find the appro- 
priate network partitioning. Mostly these methods use 
the centrality measures (i.e., a topological or a dy- 
namical [Tlj flow) based on the maximal-flow-minimal- 
cut theorem [iGj . Further effective approaches for graph 
partitioning utilize the statistical methods of maximum- 
likelihood [12, [ill , occurrence of different time scales in 
the dynamic synchronization [3| and eigenvector local- 
ization in mesoscopically inhomogeneous structures. 
In more formal approaches, the definitions of different 
mesoscopic structures in terms of simplexes and their 
combinations, simplicial complexes, are well known in the 
graph theory [l^. This approach has been recently ap- 
plied [ill to scale-free (SF) graphs and some other real- 
world networks. 

Spectral analysis of networks. Properties of the eigen- 
values and eigenvectors of the adjacency matrix of a com- 
plex network and of other, e.g., Laplacian matrices re- 
lated to the network structure, contain important infor- 
mation that interpolates between the network structure 
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and dynamic processes on it. One of the well studied ex- 
amples is the synchronization of phase-coupled oscillators 
on networks P, 0, [3 [1^, where the smallest eigen- 
value of the Laplacian matrix corresponds to the fully 
synchronized state. The synchronization between nodes 
belonging to better connected subgraphs (modules) oc- 
curs at somewhat smaller time scale [Ij, [2l| correspond- 
ing to lowest nonzero eigenvalues of the Laplacian, and 
the positive/negative components of the corresponding 
eigenvectors are localized on these modules [ll, [11] . The 
spreading of diseases 1221 and random walks and navi- 
gated random walks [2|. |23|. [2^ . 12^ are other type of the 
diffusive processes on networks which are related to the 
Laplacian spectra. 

Compared to the well known semicircular law for the 
random matrices [1^, the spectra of binary and struc- 
tured graphs have additional prominent features, which 
can be related to the graph structure [H, [H, 113, IH, 
113) [SH . Particularly, some of the striking differences 
found in the scale-free graphs are the appearance of the 
central peak or a 'triangular form' and the power- 
law tail 28, 32] in the spectral density of the adjacency 
matrix, which is related to the node connectivity. In 
the classical paper Samukhin et al. (s^l elucidated the 
role of the minimally-connected nodes on the Laplacian 
spectra of trees and uncorrelated tree-like graphs. They 
derived analytical expression for the spectral density of 
the Laplacian matrix. Other topological features of the 
graph, particularly the finite clustering [l^ and the pres- 
ence of modules JL5J , have been also found to affect the 
Laplacian spectra. Attempts to classify the graphs ac- 
cording to their spectral features were presented recently 

In this paper we study systematically the spectral 
properties of a large class of sparse networks with mcso- 
scopic inhomogeneities. The topology of these networks 
at all scales may lead to qualitative differences in the 
spectra both of the adjacency and Laplacian matrix. 
Having well controlled structure of the networks by the 
model parameters, we are able to quantitatively relate 
the spectral properties of the networks to their structure. 
As explained below, we identify different regions of the 
spectra in which certain structural features are mainly 
manifested. We further explore these networks by simu- 
lating the random walk dynamics on them. We focus only 
on two properties of random walks: hitting patterns and 
first-return time distribution, which are closely related 
to graph structure and spectrum of the Laplacian. In 
this way we would like to emphasise deeper interconnec- 
tions between the structure and the dynamics of complex 
networks and their spectra, features which often remain 
fragmented in numerous studies of complex networks. 

In Section |TT] we represent model of growing networks 
with controlled number of modules and their internal 
structure. We then briefly study the spectral density of 
the adjacency matrix of modular networks in Section [TTTl 
Section IIVI is devoted to detailed analysis of the spectra 
of the normalized Laplacian matrix, which is related to 



the diffusive dynamics on these networks. The simula- 
tions of random walks on trees and on sparse modular 
graphs with minimal connectivity M > 2 is presented in 
Section [V] Finally, a short summary and the discussion 
of the results is given in Section IVTl 



II. GROWING MODULAR NETWORKS 

We first present the model for growing networks with 
statistically defined modularity. It is based on the model 
for growing clustered scale-free graphs originally intro- 
duced in Ref. [33^. The preferential-attachment and 
preferential-rewiring during the graph growth leads to 
the correlated scale-free structure, which is statistically 
similar to the one in real WWW |33|]- Two parameters, 
a and M as explained below, fully control the emergent 
structure. Here we generalize the model in a nontrivial 
manner by allowing that a new module starts growing 
with probability Pq. The added nodes are attached pref- 
erentially within the currently growing module, whereas 
the complementary rewiring process is done between all 
existing nodes in the network. The growth rules are ex- 
plained in detail below. 

At each time step t we add a new node i and M 
new links. With probability Pq a new group (module) 
is started and the current group index is assigned to the 
added node (first node belong to the first group). The 
group index plays a crucial role in linking of the node 
to the rest of the network. Note that each link is, in 
principle, directed, i.e., emanating from the origin node 
and pointing to the target node. For each link the target 
node, fc, is always searched within the currently growing 
module (identified by its group index gk). The target 
is selected preferentially according to its current number 
of incoming links qin{k,t). The probability pin{k,t) is 
normalized according to all possible choices at time t 
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ik,t) 



Ma + qin{k,t) 
MNg^{t)a + Lg^{t) 



(1) 



where Ng^ (t) and Lg^ (t) stand for, respectively, the num- 
ber of nodes and links within the growing module g^ ■ The 
link i k is fixed with the probability a. If a < 1, there 
is a finite probability 1 — a that the link from the new 
added node i — s- fc is cut (rewired) and a new origin node 
n is searched from which the link n k established and 
fixed. The new origin node n is searched within all nodes 
in the network present at the moment t. The search is 
again preferential but according to the current number 
of outgoing links a„,,i(n. t)[33j: 



Pout{n,t) 



Ma -I- qout{n,t) 
MN{t)a + L{t) ' 



(2) 



where N{t) = t and L{t) < MN{t) are total number of 
nodes and links in the entire network at the moment t. 
Note that the number of added links is smaller than M 
for the first few nodes in the modul until M — 1 nodes are 





FIG. 1: (Color online) Examples of modular graphs with = 1000 nodes and M x N links grown from the model rules for 
different values of the control parameters: (a) M = 5, Po = 0.002, a = 0.9; (b) M = 2, Po = 0.006, a = 0.9 (Net269); (c) 
M = 1, Po = 0.006, a — 1 (NetlGl); (d) Scale-free tree with attached modules. Each module contains between 20 - 50 nodes 
and its structure is determined by the growth rules with M = 2, a = 0.9. Color/gray scale of nodes indicates their group index. 



in the module. We are interested in sparse networks, for 
instance M = 2, the second added node in a new mod- 
ule can have only one link pointing to the first node in 
that module. The second link is attempted once within 
the rewiring procedure the probability 1 — a, otherwise 
it is not added. It is also assumed that nodes have no 



in-coming or out-going links when they are added to the 
network, i.e., qin{i,i)=(lout{i,i) = 0. Some examples of 
the emergent modular graphs of size N = W nodes 
are shown in Fig. [TJ The networks which we consider 
throughout this paper are: 



J 



r 



Net269 (shown in Fig. [Jd), is grown with direct im- 
plementation of the above rules with parameters M = 2, 
Po — 0.006, which gives G k, P^N > Q distinct modules, 
and a — 0.9, leading to 10% links rewired. 
Netl61 (shown in Fig. [TJ;) is a scale- free tree with tree 
subgraphs, which is grown with the same rules as above 
and taking M = 1, G = 6 and a = 1 (no rewiring). 



Two additional networks discussed in this appear are 
trees with attached modules of different structure. They 
are grown in the following way: 

Tree with SF-modules (shown in Fig. [TJi) starts growth 
as a scale- free tree, i.e., with M = 1, a = 1 and pref- 
erential selection of the target node with the probability 



4 



Pin{k,t) = pjp^a+L(t) ■ ^ randoHi integer r in the inter- 
val [20, 50] is selected and at rth node a module of size 
r is started to grow. The module rules are preferential 
linking and preferential rewiring within the same module 
with the parameters M — 2 and a = 0.9. Subsequently 
a new integer r is selected and the tree resumes to grow 
for the following r steps, after which a module of the 
the same size is added and so on. Now the nodes in the 
modules are excluded as potential targets for the resumed 
tree growth. The relative size of the tree and modular 
structure can be controled in different ways, e.g., by the 
parameter Pq as above. For the purpose of the present 
study we keep full balance between the size of the tree 
and total number of nodes included in the modules. 
Tree with cliques is grown as a random tree, i.e., target 
node k is selected with probability pin{k,t) = 1/N{t) 
from all nodes present at time t. With probability Po a 
clique of size n is selected and attached to a randomly 
selected node. Then the tree resumes growth and so on. 

The structural properties of these networks depend 
crucially on three control parameters: the average con- 
nectivity M, the probability of new group Pq, and the 
attractivity of node a. By varying these parameters we 
control the internal structure of groups (modules) and 
the structure of the network connecting different mod- 
ules. Here we explain the role of these parameters. Note 
that for Pq = no different modules can appear and the 
model reduces to the case of the clustered scale- free graph 
of Ref . [33| with a single giant component. In particular, 
for M = 1 and Pq — Q and a < 1 the emergent struc- 
ture is clustered and correlated scale-free network. For 
instance, the case a = 1/4 corresponds to the statisti- 
cal properties measured in the WWW with two different 
scale-free distributions for in- and out-degree and non- 
trivial clustering and link correlations (disassortativity) 
[111. On the other hand, for M = 1 and P^ = 0, a = 1 
a scale-free tree is grown with the power-law in-degree 
with the exponent t = 3 exactly. 

Here we consider the case Pq > 0, which induces differ- 
ent modules to appear statistically. The number of dis- 
tinct groups (modules) is given by G ~ PqN . By varying 
the parameters M and a appropriately, and implement- 
ing the linking rules as explained above with the proba- 
bilities given in Eqs. ([T][2]), we grow the modular graphs 
with G connected modules of different topology. In par- 
ticular for Of < 1 the scale-free clustered and correlated 
subgraphs appear (cf. Fig. [T^,b). Whereas for a — 1 
the emergent structure is a tree of (scale-free) trees if 
M = 1 (Fig. [T};). Another limiting case is obtained when 
a = 1 and M > 2, resulting in a scale-free tree connect- 
ing the unclustered uncorrelated scale- free subgraphs. In 
order to systematically explore the role of topology both 
of modules and connecting networks in the spectral and 
dynamical properties of sparse modular graphs, we will 
study in parallel two network types shown in Fig.[T}5 and 
c, referred as Net269 and Netl61, respectively. 

Note that the growth rule as explained above lead to a 
directed graph with generally different connectivity pat- 



terns for in-coming and out-going links. Each module 
also tends to have a central node (local hub), through 
which it is connected with the rest of the network. The 
pattern of directed connections of the nodes within mod- 
ules and the role of the connecting node can be nicely 
seen using the maximum-likelihood method for graph 
partitioning, as shown in our previous work For 
the purpose of the present work, in this paper we analize 
undirected binary graphs, which have symmetric form of 
the adjacency matrix and the normalized Laplacian ma- 
trix. Therefore, the total degree of a node q = qin + qout 
is considered as a relevant variable, for which we find a 
power-law distribution according to 

P{q)-q-^- (3) 

In Fig. [5] we show the ranking of nodes according to their 
degree for two networks, which are shown in Fig. [T|d,c. 
The ranking distribution appear to be a broad (Zipf's 
law) with the exponent 7, which is related to the expo- 
nent in Eq. ^ with a general scaling relation 

T = - + 1 . (4) 

7 
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FIG. 2: Ranking distribution (Zipf's law) of nodes according 
to tlie total node degree qi for networks shown in Fig. [TJj 
(modular) and[T}; (tree of trees). 

The points in the flat parts of the curves at large con- 
nectivity represent the module hubs, which appear to 
have similar number of links. In the case of Net269 there 
are about six such nodes, whereas in the case of tree of 
trees two nodes, hubs of the largest subgraphs, are sep- 
arated from four other hubs, and then the rest of nodes. 
The occurrence of local hubs changes the overall slope 
of the curve, compared to the networks without mod- 
ules, where one finds analytically 7 — 1/(1 -f a) and 
thus r = 2 + a (ssl [3^ . Here we have approximately 
7 « 0.65 for modular network Net269, and 7 « 0.72 for 
tree of trees, Netl61. According to Eq. Q, r w 2.5 and 
T w 2.4, for these two networks, respectively, suggesting 
how the modularity affects the degree distribution. 
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III. EIGENVALUE SPECTRUM OF GROWING 
MODULAR NETWORKS 

The sparse network of size N is defined with a.n N x N 
adjacency matrix A with binary entries Aij = (1,0), 
representing the presence or the absence of a Unk be- 
tween nodes i and j. For the sparse binary networks 
the eigenvalue spectral density of the adjacency matrix is 
qualitatively different from the well known random ma- 
trix semi-circular law [28]. Moreover, in a large num- 
ber of studies it was found that the eigenvalue spec- 
tra differ for different classes of structured networks 
[U, in m, [13, m, m, H [U. we study the spectral 
properties of the adjacency matrix A and the related 
Laplacian matrix L (see Sec. IIVP of different networks 
with mesoscopic inhomogeneity using the complete solu- 
tion of the eigenvalue problem: 

AF/ = \fV^ . (5) 

Here the set {Xf} denotes eigenvalues and {V/^} a set of 
the corresponding eigenvectors, i = 1,2 - ■■ N, of the ad- 
jacency matrix A. For the modular networks grown with 
the algorithms in Section [IT] we focus on the effects that 
the network mesoscopic structure has on (i) the spectral 
density, (ii) the eigenvalues ranking, and (iii) the struc- 
ture and localization of the eigenvectors. 

As stated above, we use the undirected networks. Thus 
the adjacency matrix is symmetric, which is compatible 
with the real eigenvalues and the orthonormal basis of the 
eigenvector. We use the networks of the size N — 1000 
and solve the eigenvalue problem numerically. Particu- 
larly, we use the numerical routines in C from Numerical 
Recipes ^ for calculation of eigenvalues and eigenvec- 
tors of adjacency matrix with the precision 10~^. The 
spectral densities are calculated with a large resolution, 
typically AA = 0.05, and averaged over 500 networks. 



A. Change of the spectrum with network growth 
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FIG. 3: (Color online.) Top: Evolution of all eigenvalues 
of the adjacency matrix with growth of the modular network. 
Bottom: Evolution of the components of the eigenvector asso- 
ciated with leading eigenvalue with network growth. Network 
parameters: a — 0.9, M = 2 and Po = 0.008, permitting four 
modules within — 500 added nodes. Every tenth step is 
shown. Brighter/yellow-red color corresponds to larger cen- 
trality. 



We first demonstrate how the growth of the modular 
networks affects their spectrum and the eigenvector com- 
ponents. In Fig. [3] we show the eigenvalues of the grow- 
ing network with the parameters selected such that four 
modules are formed, i.e., at time step 1, 180, 338, and 
357. Growth up to 500 added nodes was shown and the 
spectrum was computed every ten steps. As the network 
grows new eigenvalues appear, with the largest eigenvalue 
split from the bulk. A remarkable feature of modular 
networks is that the additional eigenvalue splits from the 
rest of the spectrum when a new module starts grow- 
ing. In Fig, [3] (top) three top lines corresponding to such 
eigenvalues are visible. The forth module is compara- 
bly small. More detailed study of the eigenvalue spectral 
density will be discussed bellow. Here we show how the 
components of the eigenvector for the largest eigenvalue 
(eigenvector centrality) evolve in the same network. 



The ei genv ector centrality Xi of a node i satisfies the 
equation [36[ 

1 ^ 

Xi — ''^^AijXj , (6) 

hence, in view of the Eq.((6|) and positivity of the central- 
ity measures, it appears that different Xi are the com- 
ponents of the eigenvector corresponding to the largest 
eigenvalue X^^^ of the adjacency matrix A. In the bot- 
tom panel of Fig. [3] we show in a 3-dimensional color 
plot the evolution of the components corresponding to 
the largest eigenvalue of the growing network described 
above. In our network modules are interconnected {a < 
1) what leads to the localization of the eigenvector on all 
nodes in the network. However, the largest component 
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corresponds to the hub of the first module. When a new 
module is added to the network, the strongest component 
is eventually shared among the hubs of the two modules. 
During the growth of the module, however, the ccntrality 
Xi of the nodes in that module remains small until the 
module grows large enough (cf. Fig. [3]). 



B. Spectral density of clustered modular networks 
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FIG. 4: (Color online.) Spectral density of the adjacency 
matrix for scale-free networks of size A'^ = 1000 and average 
connectivity M = 5 for: (top) a = 0.9 and varied modularity 
G =1, 2, 6 modules. Inset: Part of the spectrum with largest 
eigenvalues; (bottom) fixed G = 2 and varied parameter of 
clustering a — 1, 0.9, 0.6, as indicated by color/type of line. 
Densities normalized to the maximum of the reference curve 
for a = 0.9, G = 2. 

We investigate spectral densities of undirected net- 
works grown with model presented in Section [ill Our 
main focus is on the Laplacian spectra, studied in Sec- 
tion IIVI Here we briefly summarize the main features 
of the spectral density of the adjacency matrix of our 
scale-free graphs with the modularity and clustering (see 
also [13] )• In the special case of our model when Pq — 
we have the scale-free networks without modularity. 



The spectral density of such networks, in particular un- 
clustered and uncorrelated networks, which correspond 
to our case with a = 1, was investigated extensively 
[H [H [13, il [Ml. Specifically, it was shown that 
the spectral density has a characteristic triangular shape 
and a tale^which is related to the power-law degree dis- 
tribution [H, [s^l- The largest eigenvalue is separated 
from the rest of the spectrum and its position scales with 
the largest connectivity qmax of the hub, as ~ yjqmax , 
[23] ■ In Fig. [H (top) we show the spectral density of the 
unclustered (a = 1) scale- free networks with fixed aver- 
age connectivity M = 5 and varied number of modules. 
The case G = 1 corresponds to the case well studied in 
the literature [H [13, [S, H HH . As the figure shows, 
for these type of the networks, the central part of the 
spectrum is not affected by the modularity (G > 1) with 
fixed other parameters. The differences, however, appear 
in the area of the largest eigenvalue, as shown in the inset 
to Fig. [D (top). The number of different large eigenval- 
ues increases with increased number of modules, as it was 
demonstrated in Fig. [31 which leads to broadening of the 
peak. At the same time, due to the fixed number of links 
M X N, the largest connectivity is shared between several 
hubs of the modules, which leads to the shift of the peak 
towards lower values. 

The internal structure of the modules is changed by 
varying the parameter a. In particular, networks with 
different a have different degree distribution and for 
a < 1 a finite clustering coefhcient appears, which does 
not decay with the network size ^] . In Fig. [5| (bottom) 
we show the effects of increased clustering on the spec- 
tral density of networks with fixed average connectivity 
M — 5 and fixed number of modules G — 2. The clus- 
tering coefficient for one network with 10% of rewired 
links is, i.e., a = 0.9, is Cc = 0.059. For larger fraction 
of rewired links (decreasing a) the clustering coefficient 
increases, for instance for the network with a = 0.6 we 
find Cc = 0.164. As shown in bottom panel of Fig. [H 
the central part of the spectrum is affected by increased 
clustering of the network. In our model due to the pref- 
erential rewiring when a < 1, the number of triangles 
attached to hubs increases, while the peripheral nodes 
loose links. This contributes to the increase of the central 
peak and a decay of the spectral density away from the 
central area. The increased clustering also contributes 
to a characteristic shape around the central peak. Note 
that the random rewiring, which is often used to increase 
clustering in uncorrelated scale-free networks with large 
average connectivity, M = 20 in Ref. [l9|, may generate 
uncontrolable effects. 



IV. SPECTRA OF NORMALIZED LAPLACIAN 

The Laplacian matrix L related to the adjacency ma- 
trix of the network A is usually defined as 

L« = qA, - A, . (7) 
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For the dynamics of the random walks on networks other 
forms of the Laplacian matrices have been discussed in 
the Hterature 30l 3l|. Generally, for a random or navi- 
gated walker one can define the basic proba- 
bility Pie for walker to jump from node j — > ^ in a discrete 
time unit (one time step). Then the probability Pij{n) 
that the walker starting at node i arrives to node j in n 
steps is given by 



J2 p^'i 
....i„_i 



(8) 
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Consequently, the change of the transition probability 
Pij (n) in one time step can be written via 

P,,(n+1) -I^,in)= (9) 



which defines the components of the Laplacian matrix 
Lij in terms of the basic transition probability pij of the 
walker. For the true random walk from node i equal 
probability applies for all qi links, i.e., pij = when the 
link Aij is present. Thus the Laplacian matrix suitable 
for the true random walk on the network is given by 



(10) 



and satisfies the conservation law for diffusion dynamics 
on graph [31] . We consider the symmetrical Laplacian 



Lf 



(11) 
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which is a normalized version of the Laplacian for the 
random walks [30] . (It can be related with the transition 
probability chosen as = —^== .) The Laplacian matrix 

in Eq. (jlip has a limited spectrum in the range Xf e 
[0, 2] and an orthogonal set of the associated eigenvectors 
F(Af), i = 1,2- --N, which makes it suitable for the 
numerical study. As already pointed out in Ref. [30| . 
the operators PU)) and (jlip are connected by a diagonal 
similarity transformation Sij = ^ij^fql. Hence they have 
the same spectrum {30] . 



FIG. 5: (Color online.) Spectral density of the normalized 
Laplacian for scale- free networks without modules, G = 1, 
and with G = 6 modules for scale-free trees (top) and network 
with average connectivity M = 2 and a = 0.9 (middle). Spec- 
tral density of the normalized Laplacian for scale-free network 
with G = 6 modules and average connectivity A/ = 5 and 
a = 0.9 (bottom). In each case the network size is A'' = 1000 
nodes and averaging is taken over 750 network samples. 



A. Spectral density of the normalized Laplacian of 
modular networks 

As mentioned above, the spectrum of the Laplacian 
(fTTj) is bounded within the interval [0,2], regardless of 
the size of network. The maximum value \^ax = 2 is 
found only in bipartite graphs and trees. Whereas for 
monopartite graphs with cycles the maximum eigenvalue 



is shifted towards lower values, depending on the net- 
work structure. The main part of the spectrum is cen- 
tered around unity. The minimum eigenvalue A^j„ = 
always exists and it is non-degenerate if the graph con- 
sists of one connected component. In the case of modu- 
lar graphs, which we consider here, each of the modules 
tends to behave as an independent network with its own 
zero eigenvalue. This may be manifested in the dynam- 
ics, for instance in the appearance of the time scales for 



8 




200 400 600 800 1000 



1.5 
1 

0.5 




200 400 600 800 1000 

rah) 



FIG. 6: Ranking of the eigenvalues for tree of trees, Netl61 
(top) and for modular network with M = 2, Net269 (bottom). 



partial synchronization U ^ 1/Xi [IJ, |4i| , or in the con- 
finement of the random walk inside the module, which 
affects the return times at small scale, as discussed later 
in Sec. El 

Owing to the weak coupling between these subnet- 
works, we find one zero eigenvalue and a number of small 
eigenvalues ^ A corresponding to the number of topo- 
logically distinct modules. A typical spectral density of 
L'^' of an ensemble of networks with six modules and 
the average connectivity M > 2 shows the extra peak at 
small eigenvalues, as shown in Fig. [5] (middle) and (bot- 
tom) . In the sparse graphs and particularly in trees, the 
nodes with least number of links (?m = 1 and Qm = 2 
play a special role in the form of the spectrum [2^ near 
the sharp peak in the adjacency matrix at A"^ = 0. Sim- 
ilar situation occurs at A^ = 1, shown in Fig. [5] (top). 
Furthermore, in the case of trees we find continuous 
spectrum up to zero, although network like NetlGl in 
Fig. [TJ; has tree-like topological subgraphs. The topo- 
logical modularity does not induce any new features of 
the Laplacian spectra in tree graphs. In the network 
Net269, Fig. [T]3, we have 10% of rewired links, which 
leave as much of the nodes with = 1- Consequently, 
the central peak occurs, as shown in Fig. [5] (middle) . The 



presence of cycles, however, leads to the two symmetrical 
peaks as well as the extra peak at small eigenvalues due to 
the presence of modules, Fig. [5] (middle). Comparison of 
the spectral densities in Figs. [5] (middle) and (bottom), 
suggests that the increase of the minimal connectivity 
of nodes while keeping the same number of topological 
modules, the central part of the spectrum approaches the 
one of a random binary graph (with disappearing central 
peak) and a gap opens between the lower and central 
part of the spectrum. The occurrence of the peak at 
lower part of the spectrum was noticed also in the earlier 
studies, for instance in highly connected network with 
M = 20 in [l^ , where rewiring of a large number of links 
per node eventually leads to both increased clustering 
and probability of a modular structure. In our model, on 
the contrary, it is clear that the peak at the lowest part 
of the spectrum is indeed related to the topologically dis- 
tinct modules in cyclic networks even if the networks are 
very sparse, i.e., M = 2 and M = 5, as shown in Fig. 
[SJmiddle) and (bottom). The width of the gap increases 
with the average connectivity. Also, the area under the 
small peak, compared to the central part of the spectrum 
increases with the number of distinct modules. For in- 
stance, for M = 2 we find (see Supplementary material 
(37| ) the relative weight of the small peak increases from 
0.144% at G = 2 to 1.53% at G = 16 modules. 

The spectral densities in Fig. O are obtained with en- 
semble average over many networks grown with using the 
same parameters Po^a^M. For the individual network 
realization, particularly the NetlGl and Net269 shown in 
Fig. [T]d,c, the eigenvalues are shown in the ranking order 
in Fig. [HI Within the numerical precision, the central 
plateau in the ranking distribution corresponds to the 
sharp central peak in the spectral density of an ensem- 
ble. It is also clear that the cyclic Net269 has six lowest 
eigenvalues (lower right corner) separated from the rest 
of the spectrum, and the largest eigenvalue lies below 2. 
In the tree network NetlGl, however, the spectrum ap- 
proaches both ends continuously. Additional plateau is 
found at the eigenvalue A^ = 1.707107 and symmetri- 
cally at A^ = 0.292893, corresponding to the side peaks 
in the spectral density (see Fig. O top). 



B. Structure and Localization of the Eigenvectors 

Another prominent feature of the eigenvalue problem 
of the Laplacian matrix L^'^^ is revealed by the struc- 
ture and the localization of the components of the eigen- 
vectors. For each eigenvalue Af, i = 1,2,- •• ,7V, we 
have an associated eigenvector V{Xl) with the compo- 
nents Vk,t K, — 1,2^ ■ ■ ■ N . A localization implies that the 
nonzero components V^, of the eigenvector coincide 
with a particular set of geometrically distinguished nodes 
on the network. Specifically, for the case of the cyclic 
graph, Net269, the eigenvectors associated with the low- 
est nonzero eigenvalues appear to be well localized on 
the network modules, as shown in Fig. [TJ^top). The ori- 
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FIG. 7: (Color online.) Top: Eigenvector components, indi- 
cated by five colors/gray scale, for five lowest non-zero eigen- 
values of tfie normalized Laplacian for the network Net269. 
Middle: Scatter plot of the eigenvector components for the 
eigenvalues = 0.047033 and = 0.038286 for the network 
Net269. Bottom: Scatter plot of the eigenvector components 
for the eigenvalues Af = 0.00108 and A^ = 0.000335 for the 
tree of trees, Netl61. 



gin of such localization of the eigenvectors correspond- 
ing to the lowest eigenvalues has been discussed in the 
literature [l5|, and it is related to the property of the 
Laplacian. The eigenvector corresponding to the triv- 
ial eigenvalue A'^ = for the connected network has all 
positive components and k*'' component is proportional 
to When networks consists of G disconnected sub- 

graphs, each of G eigenvectors with A-^ = has non-zero 
components only for nodes within one module. If the sub- 
graphs are not fully disconnected, but instead, few links 



exist between them, the degeneration of the zero eigen- 
value disappears, leaving only one trivial eigenvector and 
G—1 approximately linear combinations of the eigenvec- 
tors of the modules. For the orthogonality reasons, these 
linear combinations have components of both signs, as 
opposed to all positive components of the V{X^ = 0) 
vector. In the case of well separated modules, the com- 
ponents corresponding to one subgraph appear to have 
the same sign, as shown in Fig. [7|for the case of Net269. 
The more links between subgraphs exist, the distinction 
between modules appears fuzzier. The structure is also 
seen in the scatter plots in Fig. [TJmiddle and bottom) 
where the eigenvector components belonging to two small 
eigenvalues are plotted against each other. In this pro- 
jection each point corresponds to the index of one node 
on the network. The separated branches along the lines 
y — ±ax contain the indexes of the nodes belonging to 
different modules. A similar feature occurs in the case of 
tree of trees Netl61, shown in Fig. [Tljbottom). The oc- 
currence of such patterns related to the network modules 
is a direct consequence of the localization of the eigen- 
vectors. Consequently, in the absence of the appropriate 
localization, for instance in the center of the spectrum, 
A'^ = 1, the corresponding scatter plot does not exhibit 
any pattern (not shown). 

It is interesting to note that in the case of our tree 
of trees, Netl61, the localization of the eigenvectors for 
small A^ can be also observed, shown in Fig. [8^ in "real 
space" , although the separation of that part of the spec- 
tra is absent for trees, as discussed above. In addition, 
we find that the eigenvector associated to the largest 
eigenvalue on trees A^^j, = 2, also shows a characteristic 
pattern of localization with a succession of the positive- 
negative components along the network chains. The sit- 
uation is shown in Fig. [SJd. In fact, the regularity in the 
localization pattern indicates the bi-partitivity of the tree 
graph, which is associated with the A^^,^ = 2. We find 
it interesting, that the two partitions within the spectral 
analysis are not seen as different 'communities' at lower 
part of the spectrum, where rather the localization on 
the subtrees occurs, as shown in Fig. [SK- 

A scalar measure of vector's degree of localization is 
so-called inverse participation ratio (IPR) [l^, which is 
defined for any vector V{Xf) by the following expression 



Pr{V{Xf)) 



(12) 



Depending on the actual situation, IPR ranges from the 
minimum value Pr = corresponding to the eigenvec- 
tor equally distributed on all nodes in the network, to the 
maximum value Pr = 1, in the case when the eigenvector 
has only one component different from zero. Generally, 
higher values of Pr{V{Xf)) are expected for better lo- 
calized eigenvectors in subsets of nodes on the network. 
Note that the actual values of the eigenvector compo- 
nents may vary a lot throughout the network (see Fig. 
[7] (top)). Thus it is interesting to consider the number 
of nodes carrying a non-zero (within the numerical pre- 
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FIG. 8: (Color online.) Localization of the eigenvectors be- 
longing to (top) small eigenvalue A2 ~ 0.004623, and (bot- 
tom) largest eigenvalue X^ax = 2 of the Laplacian on the tree 
of trees network, Netl61. Dark (blue)/gray (green) color indi- 
cate positive/negative values of the eigenvector components. 
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FIG. 9: Number of nodes Nnz carrying a non-zero eigen- 
vector component V^iXf) plotted against the corresponding 
eigenvalue Xf for the normalized Laplacian of the networks; 
tree of trees Netl61 (top) and cyclic Net269 (bottom). 



component remains close to 300. In contrast, in the case 
of cyclic network Net269, most of the vectors are local- 
ized on 50% of the nodes (Fig.[5]bottom). The exceptions 
are the lowest eigenvalues, discussed above, and = 1, 
whose eigenvectors are located at 1/4 of the network. 



RANDOM WALKS ON TREES AND CYCLIC 
MODULAR NETWORKS 



cision) components of the eigenvector (Nnz). In Fig. [S] 
we show the number of nodes with non-zero eigenvector 
components for all eigenvectors of the normaUzed Lapla- 
cian in modular network Net269 and tree of trees net- 
work, Netl61, plotted against the corresponding eigen- 
values Xf. 

For the tree graph most of the vectors have non-zero 
components along up to 50% of nodes, however, they 
are not equally distributed over nodes. In contrast, the 
eigenvectors correspond to — 1.707107 and symmet- 
rically to A^ = 0.292893 are homogeneously distributed 
on approximately 100 nodes. For the eigenvalues close to 
unity (plateau in Fig. [6|), the IPR varies between 0.005 
and 0.27, but the number of nodes with non-zero vector 



The observed differences in the spectra of our mod- 
ular networks are also manifested in random-walk dy- 
namics on them. Many stochastic processes in differ- 
ent fields of science have been formulated and studied 
in terms of random walks (4^ . Random walks on net- 
works strictly adhere to the network structure and thus 
can be used to explore the network topology at different 
levels m. Hi, m, lii]. Two fundamental features of the 
random-walk processes, on which we will focus in the con- 
text of the present work, are described by (a) the number 
of hits of a random walker to network nodes, related to 
network's transitivity and recurrence; and (b) the distri- 
bution of first return times, which is closely related to the 
distribution of all returns and to the Laplacian spectrum 
of the network. 
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FIG. 10: (Color online.) Statistics of true random walks on (a) trees and tree-like structures and on (b) cyclic modular networks 
Net269, Net569, and scale-free network SFM2, all with average connectivity M > 2, and for mixed network with 50% of nodes 
belonging to large modules and 50% to the connecting tree, shown by thick pale (cyan) line, (c) Dispersion against average of 
the number of hits time series for all nodes on two networks: tree of trees, and cyclic network with average connectivity M=2 
and six modules, Net269. (d) Ranked time-averaged number of hits per node (/li) versus node rank for two networks as in 
(c), and for scale- free tree. 



We simulate the random walks on the networks studied 
above, Net269 and Netl61, and similar structures, which 
contain iV — 1000 nodes and random walks on each net- 
work perform up to 2 x 10* steps. For improved statistics, 
the total number of walker steps consists of 2000 pieces as 
follows: First a random walk is started from a node i and 
when it first arrives to an in advance randomly selected 
node 2^ then a new target node A; is randomly selected, 
etc. In the simulations we measure the elapsed time At 
between two successive visits of the walker to the same 
node (first return to the origin). The times At are mea- 
sured at each node of the network and the distribution 
P(At) averaged over all 10^ nodes (origins) and over the 
ensemble of 2000 walks. 

The probability density functions of the return times, 
P(At) is shown in Fig. [TO] (a) and (b) for different trees 
and cyclic networks. In addition, we sampled the time 



series of the number of hits of the random walker {hi(t)} 
within a fixed time window of Twin = 1000 steps, for 
each node in the network i = 1, 2, • • • , A^. In Fig. [TOk 
the results for the first return-times distribution of the 
walker to a node is shown for the case of of the random 
walks on scale-free tree, the tree of trees and for the tree 
with cliques. The numerical results show no significant 
difference for all kinds of trees (all data are log-binned 
with a very small base b = 1.01). Moreover, for At >> 1 
the data are well fitted with the expression 

P{At) = S(At)-'' X exp [-(At/a)'"] (13) 

(shown by full line in Fig. [TOb). with the exponents 
77 = 0.23 and a = 0.33 within a numerical error. The 
presence of small cliques attached to the tree (network 
shown in Fig. (TJl) does not affect the tail of the distribu- 
tion P(At) suggesting that long return times are mainly 
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determined by the tree structure of the underlying graph. 
Note also that there are no significant difference between 
the random walks on the random tree and the scale-free 
tree, as well as the tree of trees (network in Fig. [T]:). In 
one of the early works considering the diffusion on ran- 
dom graphs [43| the exponent 1 /3 for the case of random 
walk on a tree was derived by heuristic arguments. 

A similar expression fits the distribution in the case 
of random walks on cyclic graphs, however, with differ- 
ent exponents. The fit suggests the stretching exponent 
a « 0.66, that is twice larger compared with the case 
of trees. The simulations of random walks on various 
cyclic networks, also shown in Fig. [TOb . suggest that, 
within the numerical accuracy, the tail of the distribution 
P(At) is practically independent on the size of cycles in- 
cluding triangles. A short region with very small slope is 
found in the intermediate part of the curve, in agreement 
with Eq. (|13p with very small r\. For short return times 
Ai < 10^ wc find tendency to a power-law dependence as 
P(Ai) ^ (Ai)^^, which is more pronounced in networks 
with increased clustering and modularity. For the tree 
with attached modules, described in Sec. [Til and shown 
in Fig. [TJi, the tail of return-time distribution -P(At) on 
this network are also shown in Fig. [TOb : the tail tends 
to oscillate between the curves for the trees (long-dashed 
line) and the cyclic graphs, with a pronounced crossover 
at short times. 

Analysis of the time series {/ij(t)} of the number of hits 
of the random walker to each node reveals additional reg- 
ularity in the dynamics, which underly the return-time 
distribution. In Fig. [TUb we show the scatter plot of the 
dispersion oi of the time series hi(i) against the aver- 
age < hiit) >t for each node i = 1,2, ■ ■ ■ , N represented 
by a point. As shown in Fig. [TUb . long-range correla- 
tions in the diffusion processes on networks lead to a 
non-universal scaling relation [2^ 

ffi — const X {hi)^ , (14) 

where the averaging over all time windows is taken. The 
exponent /i depends on the network structure and the 
size of the time window. The origin of scaling in diffusive 
processes on networks has been discussed in detail in 
and references therein. Here we stress the differences 
of the underlying networks for the fixed time window 
Twin ~ 1000: we find /i = 0.7 and /i = 0.62 for tree of 
trees and modular network Net269, respectively. In this 
plots the groups of nodes that are most often visited can 
be identified at the top-right region of the plot. 

Ranking distribution of the average number of hits < 
hi{t) >t at nodes is shown in Fig. fTUH for the same two 
representative networks. Generally, the number of hits 
of true random walker to a node is proportional to node 
connectivity (43| and thus, the ranking distribution is a 
power- law with the slope 7 which is directly related to the 
ranking distribution of degree in Fig. [2] In the presence of 
network modularity we realize the flat part of the curve, 
representing most visited nodes. In our modular network, 
like Net269, these nodes are roots of different modules. 



A similar feature can be seen in the case of tree of trees 
(top curve in Fig. fTUH). However, closer inspection of the 
number of hits in time, shown in 3-dimensional plot in 
Fig. [Til suggests that the most visited nodes on the trees 
are not necessarily related to the roots of the subtrees. 
Whereas, in the cyclic modular Net269 the root nodes 
of each module can be clearly identified as most visited 
nodes and are identical to the most connected nodes in 
each module. 




1X1000 



FIG. 11: (Color online.) 3-dimensional plot of the tempo- 
ral evolution of random walks on tree of trees, Netl61 (top), 
and on cyclic modular network, Net269 (bottom). Indexes of 
nodes are shown along the vertical axis, while the horizontal 
axis indicates 130 time windows, each consisting of 1000 time 
steps. Color code represents the number of hits of the ran- 
dom walk at the node within the corresponding time window. 
Brighter/yellow-red color indicates larger number of hits. 



VI. CONCLUSIONS 

We have presented a model of growing modular net- 
works in which we tune the structural properties at 
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all scales by varying the respective control parameters. 
Specifically, the parameter Pq controls the number of 
topologically distinct subgraphs (modules); the param- 
eter a is directly related to the number of rewired links 
which, in turn, determine the clustering inside the scale- 
free subgraphs and connections between different mod- 
ules; the parameter M is the average number of links 
per node, which can be varied independently on the clus- 
tering and modularity. The wide class of mesoscopically 
inhomogeneous networks grown by varying these param- 
eters includes the sparse modular graphs with variety of 
topological features, both within the modules and at the 
level of the connecting network. Two limiting cases are 
the interacting scale-free networks with finite clustering 
and correlations, at one end, and a scale-free tree sup- 
porting a large number of cyclic modules, on the other 
(see Fig.[T]). 

We further study the spectral properties of these net- 
works by focusing on the normalized Laplacian matrix 
which is related to the diffusion (random walk) processes 
on these networks. We have also explored these net- 
works by simulating random walks on them. The sys- 
tematic analysis of the spectra while the network grows 
and by varying the control parameters enabled us to 
point out the role played by a specific topological prop- 
erty of the network (controlled by different parameter) 
in their spectra and the dynamics. Two prototype mod- 
ular networks — tree connecting scale-free tree subgraphs 
(Net 161) and the cyclic graph connecting scale-free clus- 
tered subgraphs (Net269), exhibit systematic differences 
at the level of spectra and the random-walk dynamics. 

Our complete spectral analysis reveals the firm connec- 
tion between the structure and spectra. We have found 
several new results and also demonstrated clearly how 
some expected results for this type of graphs are related 
to the structure. Specifically, we point out: 

• the role of most connected nodes as opposed to the 
role of the underlying tree graph; 

• the role that least connected nodes play in the ap- 
pearance of the central peak; 

• how the increased clustering changes the shape of 
the spectrum near the central peak; 

• the appearance of the extra peak at small eigenval- 
ues of the normalized Laplacian; In view of our fine 
tunning of the structure, this peak is related to the 
number of distinct modules even if the graphs are 
very sparse, as long as they are cyclic; Increased 
clustering does not affect this peak; 



• the Laplacian spectra of trees are different, partic- 
ularly, they do not show extra peak related with 
the (tree) subgraphs; 

• the eigenvector components show the expected pat- 
tern of localization on modules in the case of small 
nonzero eigenvalues of the Laplacian. In spite of the 
differences in the spectral density, we find a similar 
localization pattern in trees with tree subgraphs. 
In addition, we find a robust localization along the 
network chains of the eigenvectors for largest eigen- 
value of the Laplacian — 2, occurring only in 
trees and bipartite graphs; 

• the simulation results for the first return-time dis- 
tribution of the random walks, averaged over net- 
work nodes, on different tree graphs exhibits a 
power-law with stretching exponential cut-off with 
CT « 1/3 in ag reement with Eq. (|13p and heuristic 
arguments [43]; 

• when the graph contains cycles, the distribution be- 
longs to another class of behavior with twice larger 
stretching exponent. The numerical results do not 
dependent on the clustering coefficient. The pres- 
ence of modules and increased clustering affect the 
behavior at small times, where a power-law decay 
occurs before the cutoff. 

Our systematic numerical study along the line 
structure-spectra-random-walks quantifies the relation- 
ships between different structural elements of the net- 
work and their spectra and the dynamics. We hope that 
the presented results contribute to better understand- 
ing of the diffusion processes on the sparse graphs with 
complex topology. Potentially, some of our findings may 
be used for fine differentiation between classes of graphs 
with respect their spectral and dynamical properties. 
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